Method and apparatus for transferring digital content between
mobile devices using a computing cloud

ABSTRACT

A method and apparatus is disclosed for transferring digital content from a computing cloud to a computing device and generating recommendations for the user of the computing device.

PRIORITY CLAIM

This is a continuation application of U.S. patent application Ser. No.13/567,516, filed Aug. 6, 2012, which is a continuation application ofU.S. patent application Ser. No. 13/443,365, filed on Apr. 10, 2012,which claims the benefit under 35 USC 119(e) to U.S. Provisional PatentApplication Ser. No. 61/563,320, filed on Nov. 23, 2011. Thisapplication also claims priority under 35 USC 120 and is acontinuation-in-part of U.S. patent application Ser. No. 12/761,313,filed on Apr. 15, 2010 and titled “Method And Apparatus For TransferringDigital Content From A Personal Computer To A Mobile Handset,” now U.S.Pat. No. 7,937,451, which is a continuation-in-part of U.S. patentapplication Ser. No. 12/355,546, now U.S. Pat. No. 7,865,572, filed onJan. 16, 2009 and titled “Method And Apparatus For Transferring DigitalContent From A Personal Computer To A Mobile Handset,” which in turnclaims the benefit under 35 USC 119(e) to U.S. Provisional PatentApplication Ser. No. 61/040,131, filed on Mar. 27, 2008, and is acontinuation-in-part and claims priority under 35 USC 120 to U.S. patentapplication Ser. No. 11/788,711, now U.S. Pat. No. 7,865,571, filed onApr. 20, 2007 and titled “Method And Apparatus For Transferring DigitalContent From A Personal Computer To A Mobile Handset,” which in turnclaims priority under 35 USC119 (e) and 120 to U.S. Provisional PatentApplication Ser. No. 60/879,416 filed on Jan. 8, 2007. All of thesepreceding applications and patents are incorporated by reference herein.

FIELD

The embodiments relate generally to a method and apparatus forgenerating recommendations for the user of a cloud computing service.

BACKGROUND

With the increase in storage capacity of hard disk drives and theprevalence of optical CD and DVD drives, users now can store theirentire musical libraries on their personal computer (PC). For example,various software programs such as iTunes (offered by Apple Computer)allow a user to load musical content from CDs, store it on thecomputer's hard disk drive, organize the different content, and thenplay the music on the PC or burn all or part of the musical collectiononto a CD or DVD. Users also can transfer the musical files to otherdevices, such as an iPod (offered by Apple Computer) or an MP3 player.These transfers typically require a direct, hardwired connection betweenthe PC and the device, such as through a USB cable.

In recent years, mobile handsets (such as cellular phones and PDAs) haveevolved beyond mere telephone and data collection devices. For example,many cellular phones now have sophisticated display screens and audiocapabilities. Various companies (including mSpot, Inc., the assignee ofthis application), offer audio and video content that is “streamed” tothe cellular phone using a wireless cellular network. This allowscellular phone users to listen to music or other audio content and watchmovies or other video content on their cellular phones. However, theuser's choices are limited to the content offered by the provider. Whatis needed in the art is a system that allows a user of a mobile handsetto obtain digital content that he or she previously had stored on apersonal computer or other device by downloading the content over awireless network and to store it on the mobile handset.

In addition, today's systems offer fragmented digital content servicesthat require a user to go to different web-sites, different devices ordifferent services to be able to gain access to their digital content,such as Internet radio, music collections, news, local radio and fulltrack music for example. Thus, it is desirable to provide a system thatcan store all of the different types of digital content in one locationand allow the user to access the digital content and it is to this endthat the disclosure is directed.

In addition, with the vast volume of digital content that is stored andpotentially can be stored in a computing cloud, it is desirable toprovide recommendations to users who access the computing cloud toassist them in finding digital content that is correlated with theirpersonal preferences and patterns. It would also be desirable for therecommendations to be based at least in part on the preferences andpatterns of members of a user's social network.

The prior art also includes digital content players, such as iPods orother computing devices, that allow a user to select a playlist or othergrouping of digital content and to play an item in that playlist orother grouping, and then once the player has finished playing that item,to select another item from that playlist or grouping and begin playingthat item without further user instruction. Using this prior art device,the player will always be playing digital content and the user can enjoythe content without constantly instructing the player what to play next.The prior art also includes a queuing feature, such as on the Rhapsodymusic service, whereby a user can create a queue of digital content andthen the computing device plays items in the order contained in thequeue. Once the computing device finishes playing all of the items inthe queue, the computing device typically will have nothing left to playand will remain idle until further instructed by the user. This resultsin an undesirable downtime where nothing is being played. In addition,in the prior art, if the user is playing items in the queue and thenselects an item that is not in the queue (for example, a song that islisted elsewhere), the computing device typically will stop playingitems in the queue and will start playing the item selected by the user.Once that item is done playing, the computing device will have nothingto play and will go into downtime again. It would be desirable to createan improved system whereby the user can create a queue, while the queueis playing select an item that is not in the queue, and then have thesystem automatically play other items within the selection from whichthat item was chosen so there is no downtime.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of the prior art system involving a PC and anaudio device such as an iPod or MP3 player and/or a portable storagedevice;

FIG. 2A illustrates a first embodiment of a system that allows a deviceto download music from a computing device using a wireless network andthe Internet;

FIG. 2B illustrates a second embodiment of a system that allows a deviceto download music from a computing device using a wireless network andthe Internet;

FIG. 3 is a flowchart showing a method for downloading music from a PCto a mobile handset;

FIG. 4 shows an example of a user interface on the mobile handset fordownloading music from a PC to the mobile handset;

FIG. 5 illustrates another embodiment of the system that allows a mobilehandset to share content with a computing device;

FIG. 6 illustrates another embodiment of the system that allows a mobilehandset to share content among a plurality of computing devices;

FIG. 7A illustrates a piece of content segmented into smaller pieces;

FIG. 7B illustrates a method for downloading content to a mobile devicethat does not support progressive downloading;

FIG. 8 illustrates a network aware mobile handset application of thecontent sharing system;

FIG. 9 illustrates an example of a computer interface of the contentsystem that allows synchronization of digital content and adding digitalcontent;

FIG. 10 illustrates an example of a web interface of the content systemthat allows synchronization of digital content;

FIG. 11 illustrates an example of a user interface that allows the userto purchase a piece of digital content;

FIG. 12 illustrates an example of a user interface that allows the userto listen to a personal radio station using the content system;

FIG. 13 illustrates an example of a television interface of the contentsystem;

FIG. 14 illustrates an example of the user interface for on-demanddigital content of the content system;

FIG. 15 illustrates an example of a community user interface of thecontent system;

FIGS. 16A and 16B illustrate two examples of a user interface of thecontent system on a device;

FIG. 17 illustrate examples of a user interface of the content system onseveral different devices;

FIG. 18 illustrates an example of the user interface for songs/playlistsavailable to a device;

FIG. 19 illustrates an example of the user interface for a digitalcontent player on a particular device;

FIG. 20 illustrates an example of the lyric user interface for a digitalcontent system on a particular device;

FIG. 21 illustrates an example of a live wallpaper function of a digitalcontent system on a particular device;

FIG. 22 illustrates an example of a desktop widget of a digital contentsystem on a particular device;

FIG. 23 illustrates an example of a quick search support function of adigital content system on a particular device;

FIG. 24 illustrates an example of a docked playback client of thedigital content system on a particular device;

FIG. 25 illustrates an example of notification service integration ofthe digital content system on a particular device; and

FIG. 26 illustrates an example of live folders of the digital contentsystem on a particular device.

FIG. 27 illustrates an implementation of an embodiment of a system forcontent social networking;

FIG. 28 illustrates an example of a method for content socialnetworking;

FIG. 29 illustrates an implementation of an embodiment of the system forcontent social networking that incorporates geography; and

FIG. 30 illustrates a geographical embodiment for content socialnetworking.

FIG. 31 illustrates a geographical embodiment for content socialnetworking.

FIG. 32 illustrates an exemplary graphical user interface for ageographical embodiment for content social networking.

FIG. 33 illustrates an implementation of an embodiment for a contentstore and data structures therein.

FIG. 34 illustrates another implementation of an embodiment for acontent store and data structures therein.

FIGS. 35A and 35B illustrate an implementation of an embodiment for arecommendation engine.

FIG. 36 illustrates another implementation of an embodiment for acontent store and data structures therein.

FIG. 37 illustrates an implementation of a recommendation engine andadvertising engine.

FIG. 38 illustrates another implementation of an embodiment for acontent store and data structures therein.

FIGS. 39A and 39B illustrate another embodiment of a system and methodthat allows a device to download music from a computing device;

FIG. 40 illustrates an embodiment of a system and method that allows adevice to confirm the ownership rights of a user to a particular pieceof digital content;

FIGS. 41A and 41B illustrate another embodiment of a system and methodthat allows a device to download music from a computing device;

FIG. 42 illustrates another embodiment of a system and method thatallows a device to confirm the ownership rights of a user to aparticular piece of digital content; and

FIG. 43 illustrates a queue data structure for storing digital content.

DETAILED DESCRIPTION OF ONE OR MORE EMBODIMENTS

FIG. 1 depicts the prior art system in which a user stores digitalcontent (such as music, video, etc.) on computer 10. Computer 10 can bea desktop, notebook, server, or any other type of device that can storedigital data. User connects portable entertainment device 12 to computer10 using interface 14. Portable entertainment device 12 can be an iPod,MP3 player, or any other device that can store and play digital content.Interface 14 is a direct connection between computer 10 and portableentertainment device 12 and typically is a USB cable or Firewire cable.

In the alternative, a user can connect portable storage device 16 tocomputer 10 to download the digital data, and then disconnect portablestorage device 16 from computer 10 and then connect portable storagedevice 16 to portable entertainment device 12 to download the data ontoportable entertainment device 12. Portable storage device 16 can be aFlash ROM chip, a hard disk drive, or other storage device.

FIG. 2A depicts a first embodiment of a system that allows a mobilehandset to download digital content from a computer using a wirelessnetwork. As in the prior art, a user stores digital content (such asphotos, music, videos, Internet radio, news, local radio, podcasts,etc.) on a computing-based system 10. However, in this embodiment, theuser downloads the digital data from computer 10 to a device 20 in awireless fashion over a wireless communication path. Device 20 may be aPDA, mobile phone, wireless email device (such as the Blackberry), orother handheld device that has wireless connectivity to be able tocommunicate with the computer 10 and download digital content from thecomputer 10. Computer 10 communicates with a device 22, such as a servercomputer, over network 24. Network 24 can be any type of network, suchas the Internet, and can be hardwired, wireless, or some combination ofthe two. Computer 10 runs a software application that allows a user tocatalog and organize the digital content of the user. The device 22 canbe accessible over the Internet (such as through a URL address). Thedevice 22 is shown in FIG. 2 as a single device. However, it is to beunderstood that the device 22 can instead comprise multiple devices,such as multiple servers.

Device 20 connects to device 22 over a wireless network 26. Wirelessnetwork 26 can be a cellular telephone network, a WiFi network (such asan 802.11 network), a wireless data network (such as EV-DO, EDGE, 30 orLTE), WiMAX, a broadband network or any other wireless network. It is tobe understood that wireless network 26 need not connect directly toserver device 22, but instead can connect through an indirect means suchas by the Internet or through another network. The embodiment will befurther described with reference to FIG. 3.

FIG. 2B illustrates a second embodiment of a system that allows a device20 to download digital content from a computing device 28 using awireless network and the Internet 24, 26. In this embodiment, thecomputing device 28 may be a computing cloud (with a plurality ofprocessing unit based devices, storage devices, etc.) that allows a userto store their digital content in a digital content store for the user.Thus, in this embodiment, the computing device may include the computer10 and the device 22 described above. As shown, the cloud may store thevarious digital content, such as photos, ringtones, Internet radio, fulltrack stores, music collections, news and local radio, in a storeassociated with the user so that access to the digital content of theuser is limited to the user and other authorized people and devices 20.Thus, the user can connect to the cloud to interact with their digitalcontent that is no longer siloed on a particular device or in aparticular location. In this embodiment, each device 20 may be aprocessing unit based device with sufficient processing power, memoryand connectivity, such as an MP3 player, smart phones, mobile phonespersonal computer, laptop, set-top box, television, in car digitalcontent system or game consoles, to interact with the computing device28 and play/display/interact with the digital content using theapplication described below. Each device may also have a digital contentstore that may be implemented in software and stored in the memory ofthe device. The system may also use various applications/accessdevices/application to access the digital content on the computingdevice 28 since the digital content can be accessed using typicalbrowser applications, facebook or other applications or proprietarymobile device applications and browsers.

In this embodiment, each device 20 may include anplug-in/application/plurality of lines of code that is downloaded/storedon the device 20, stored in the memory of the device and executed by theprocessor of the device wherein the plug-in/application/plurality oflines of code, among other things, implements a digital content userinterface on each device as described below in more detail. Eachplug-in/application/plurality of lines of code on each device may alsoautomatically in the background (passive sync) or when a low costnetwork is available, transfer all of the digital content on the deviceup to the computing device 28 to provide for the intelligence upload ofthe digital content. The plug-in/application/plurality of lines of codeon each device may also actively sync the digital content (an activeprocess that syncs the digital content), batch sync the digital content(synchronize a group of pieces of digital content at a predeterminedtime, periodically or when a particular link is available) or a prioritysync.

In the priority sync, the pieces of digital content for each user areprioritized and then synchronized between the device(s) and the contentstore based on the priorities. The priorities can be determined based onmanual prioritization or automatic prioritization (based on storage sizelimits or scoring of the digital content) or a combination of manual andautomatic prioritization. The automatic prioritization can be manuallyoverridden by the user. Manual prioritization allows the user todesignate certain pieces of digital content so that those pieces ofdigital content are synched first. In one implementation, all manualprioritized digital content is synched before other digital content. Thestorage size limits prioritization may prioritize the digital contentfor synching based on the overall size of the digital content in thecollection of the user, the size of the digital content store in thecloud of the user and/or the storage size of a particular device 20. Thescoring of the digital content may use one or more different metrics,such as for example the number of times a piece of digital content hasbeen played, whether a piece of digital content appears on a playlist,whether or not the piece of digital content was recently added/purchasedby the user, the popularity of the piece of digital content, etc.) torank each piece of digital content and sync the digital content based onthe rankings. When the manual and automatic prioritization are usedtogether, the content system may, for example, include all manuallyprioritized digital content, and then include as much of theautomatically prioritized digital content for the storage size available(on the cloud/computer or on the device) unless the user has overriddenthe automatically prioritized digital content.

At all times, each plug-in/application/plurality of lines of code oneach device 20 may have a list of the digital content of the user (whichmay be just the content on the device or all of the content of theuser), but the actual digital content filed may be stored in thecomputing device 28. The plug-in/application/plurality of lines of codeon each device 20 may also include a digital content replacement processto ensure that each device has sufficient memory space to store thenewest downloaded digital content. The replacement strategy may be aleast recently used strategy (where the least recently used digitalcontent is deleted), a least recently played strategy and the like. Inaddition, for certain devices 20 that allow multiple executive threads(such as devices using the Android operating system, for example), theplug-in/application/plurality of lines of code may incorporate abackground process that synchronizes the digital content list to thedevice without user involvement. FIG. 26 illustrates an example of auser interface of this type of device that provides live folders andbackground synching.

In the embodiment shown in FIG. 2B, the content store in the cloud 28 orcomputer 10 may store digital content for each household member/memberof the group that owns the digital content. Then, each user or eachdevice 20 may select some portion or all of the entire digital contentstore for the group to synchronize to the device 20 of the user. Forexample, in a family with a father, a daughter aged 12 and a son aged 16who share the digital content store in the cloud 28, the father,daughter and son may have different musical tastes, for example, andtherefore each of the father, daughter and son may synchronize (usingplaylists, etc.) a subset of the entire digital content store to theirpersonal device. The owner of a particular content store in the cloud 28or computer 10 may also be allowed to authorize one or more additionaldevices 20 (up to N devices) to synchronize with the content store suchas to allow a new device to use the digital content in the contentstore.

In addition to the downloading and exchanging of the digital contentbetween the device 20 and the computer 10, the second embodiment of thesystem also allows a user to directly transfer digital content betweenthe various devices 20 using a wired or wireless connection. In oneimplementation, the computing device 28 may include a manager unit (thatmay be implemented in software on a server computer that is part of theoverall computing device 28) that manages the device 20 to device directtransfer of digital content (authentication, protocols, etc.) and thedevices 20 interact with the manager unit. In another implementation,the plug in/application/plurality of lines of code each device mayinclude lines of code to implement the direct transfer of digitalcontent since each device is aware of its neighbors of certain networks,such as LANs, and can thus initiate a transfer of the digital content.The device to device transfer may occur over a hardwire link, such as aUSB cable or a LAN, a wireless link, such as Bluetooth, Wifi or 3G, orusing a hardware device, such as an SD card. The system may select thefastest link available when transferring the digital content. The deviceto device transfer may be controlled/managed by a computer of thecontent system. For example, the computer of the content system maydetermine the identifier of each device that wants to participate in thedirect transfer, authenticate that each device is authorized tosynchronize with the content store and then allow the direct transfer ifboth device are authenticated. The computer or each device may determinethe appropriate link over which to exchange the digital content.

The synching of digital content directly between devices as well as thesynching between the computer/cloud 10, 2.8 can be managed in a numberof ways. For example, the synching can always operate over the lowestcost network available to reduce the data costs. For the device 20 thatis plugged into a power source, synching can be done in the backgroundsince the synching will not drain the battery of the device whereas adevice operating on battery power may deactivate background synching orslow down the synching even if a fast network is available to preventbattery drain. On a computer 10, the content system may throttle thesynching based on the other usage of the computer by the user. Forexample, when the screen saver is active (meaning no use by the user),the synching may go as fast as possible whereas when the computer isbeing used by the user for other activities, the synching process may bereduced so that the synching does not interfere with the overalloperation of the computer.

FIG. 3 is a flowchart depicting the interaction of the various elementsshown in FIG. 2. Computer 10 connects to device 22 over network 24.Computer 10 then registers with device 22 (30) so that device 22associates the digital content in the computer 10 with a particular userand a particular mobile handset. Computer 10 then listens on an openhttp connection to device 22 (32) and waits for communications fromserver device 22. Mobile handset 20 contacts server device 22 (34) overwireless network 26. Once the computer 10 is registered with the device22, the user of the mobile handset, when the handset is turned on, seesthe digital content actually stored on the mobile handset as well as thedigital content stored in the computer 10 in a single display as shownin more detail in FIG. 4. When the user of the mobile handset wants touse a piece of digital content stored on the computer 10, the mobilehandset 20 issues a command to computer 10 (36), such as a command totransfer a certain piece of digital content. Computer 10 responds to thecommand and transfers the digital content to device 22 (38). Mobilehandset 20 then obtains digital content from device 22 (step 40). Thus,mobile handset 20 is able to obtain digital content (such as a musicfile) from computer 10 in a fashion that is at least partly wireless.Using the above system and method, a user may have digital contentstored on his/her computer as well as on the mobile handset and maysynchronize the digital content between the computer and the mobilehandset in a wireless manner. For example, the system permits a user tohave a much larger digital content catalog available for use than can bestored in the mobile handset. In addition, the system permits the userto download particular digital content at any time, such as downloadinga particular movie before a long airplane flight. The user also candownload additional data associated with the digital content, such asmetadata (artist information, duration, title, etc.), cover art, andother data.

FIG. 4 shows an embodiment of a user interface for mobile handset 20once the computer 10 is registered with the device 22. FIG. 4 shows anumber of different screens that might be displayed on mobile handset20. These screens are generated by a software application running onmobile handset 20. The software application on the mobile handsetobtains (when the digital content is not already stored in the mobilehandset), organizes, displays (both digital content on the mobilehandset and the computer 10), stores and plays digital content and cangenerate the user interface described below.

Screen 50 provides the user with two choices—to view a list of filesthat have been downloaded from computer 10 (“Downloaded”) and are storedon the mobile handset, or to view a list of all files (“All”) includingthe digital content stored on the mobile handset and the digital contentstored on the computer 10. If the user selects the “Downloaded” option,then in screen 52, the user can then choose a subset of the files (byartist, album, or playlist) or to view all of them. If the user selects“All,” then mobile handset 20 displays all available music files,including files that have been or can be downloaded from computer 10. Inthis embodiment, song titles in normal, black text already have beendownloaded to mobile handset 20, and song titles in gray text have notyet been downloaded but can be downloaded. In Screen 54, the userselects the song “All Night Long,” which already has been downloaded,and in Screen 56, the song plays on mobile handset 20 while cover artand other relevant information is displayed for the song “All NightLong.”

When the user selects the “All” option in screen 50, the user ispresented with a menu (58) that permits the user with options to viewall of the digital content (both stored on the mobile handset and storedon the computer) including “All”, by Artist, by Album and/or byPlaylist. When the user selects to view all of the digital content(which are songs in this example), a screen 60 shows all of the digitalcontent (both on the mobile handset and on the computer) wherein certainpieces of digital content are shown in gray text indicating that thosepieces of digital content are stored on the computer and are availablefor download to the mobile handset and other pieces of digital contentare shown in black indicating that those pieces of digital content arestored on the mobile handset. If the user selects “Because of You”(which is shown in gray text), mobile handset 20 then issues a commandto computer 10 (36), such as a command to transfer the song “Because ofYou” from the computer to the mobile handset. Computer 10 responds tothe command and transfers the requested digital content to server device22 (38) and the mobile handset 20 then obtains the digital content fromserver device 22 (40). Once the piece of digital content (or at least abuffer full of the piece of digital content as the piece of digitalcontent continues to download in the background) is downloaded to themobile handset, screen 62 then shows the cover art and other relevantinformation for the song “Because of You” as the song is being played.When the digital content is downloaded onto mobile handset 20, it isplayed on mobile handset 20 and is also stored in a storage systemwithin mobile handset 20 (such as on Flash RAM chip or disk drive) whileit is being played. The digital content (a song in the example in FIG.4) is thus added to the music collection stored on mobile handset 20.When that song is displayed in a menu in the future, it will bedisplayed in normal, black text rather than gray text since it has nowbeen downloaded and stored on mobile handset 20.

In this manner, the digital content on mobile handset 20 can besynchronized with the digital content on computer 10 in a wirelessfashion. This allows a user to listen to or watch the digital contentthat is stored on computer 10, even when the user is in a locationremote from the computer 10.

Device 22 can implement security or verification measures to ensure thatthe person operating mobile handset 20 is the same person who ownscomputer 10, for copyright protection and other reasons. For example,device 22 can require that computer 10, when the computer registers withthe device 22, provide device 22 with the phone number for the mobilehandset that will be allowed to access the digital content stored oncomputer 10. When mobile handset 20 then contacts device 22 with arequest to obtain data from computer 10, device 22 can then determine ifthe phone number associated with mobile handset 20 is the same phonenumber that previously had been registered by computer 10. Device 22 canbe designed to proceed with the requested transfer only if the two phonenumbers match. Other security or verification measures can beimplemented, and this example is only illustrative.

Mobile handset 20 may include circuitry for running an operating systemand applications, circuitry for processing data and metadata, andcircuitry for rendering and playing the digital content, such as audiocontent and video content. All of the circuitry can be contained in asingle integrated chip, in multiple integrated chips, or in acombination of some number of integrated chips and other electroniccomponents.

A user of mobile handset 20 can run various applications on the handset,such as an application that enables the user to listen to music or towatch video content. Mobile handset 20 can include a video display and aspeaker, which would enable a user of mobile handset 20 to watch videocontent on the video display and listen to audio content through thespeaker.

FIG. 5 illustrates another embodiment of the system that allows a mobilehandset 20 to share content with a computing device 10. In thisembodiment, the mobile handset 20 can share content with the computingdevice 10 through the device 22 (as described above), but may also sharecontent/synchronize content with the computing device 10 over a link 70,such as a cable, a docking station, by removing a memory card from themobile handset 20 and reading the memory card using a memory cardreading device coupled to the computing device 10 or by other wirelessprotocols such as a Bluetooth network. In this embodiment, thesynchronization of the content over the two different methods (throughthe device 22 and over the link) requires that the system tracks thesynchronization by both methods. The system may also permit multiplecomputing devices and multiple handsets (assuming that the user has theproper authorizations to share the content) to share the content.

The mobile handset may include a content store 71, such as a database,that may include one or more playlists 72 and the computing device 10may a content store 74, such as a database, and one or more pieces ofcontent 75. In the computing device 10, the one or more pieces ofcontent may have a plurality of different formats (such as MP3, AAC,ACC+, m4a for music content) and the system may be used with multipledifferent types of content including music content, photo content, filecontent, video content, podcasts and any other type of digital content.

The computing device, using the content store 74, identifies any newcontent files so that those new content files can appear in the userinterface of the mobile handset described above and new files downloadeddirected to the mobile handset appear in the master content storemaintained on the computing device 10. The content store 71 on eachmobile handset may include an identification code (ID) so that thecomputing device 10 may contain a plurality of content stores for aplurality of mobile handsets wherein the content stores for each mobilehandset are distinguished by the identification code. A user can alsocreate a new playlist on the mobile handset that is stored in thecontent store 71 and then is synchronized back to the computing device10 so that the computing device also maintains the playlists for theparticular mobile handset in the content store for that particularmobile handset as identified by the identification code.

In the system and method described above, the playlists generated on themobile handset may be an on-the-fly playlist which allows content (bothlocal to the mobile handset and the computing device 10 as well contentfrom any source that can be later pulled down to the mobile handset) tobe stored into a playlist on the mobile handset. As above, theon-the-fly playlist may be synchronized back to the computing device 10.In addition, when content stored on the computing device changes(content is removed, for example or the user no longer has rights toplay a particular piece of content), the on-the-fly playlist (and otherplaylists on the mobile handset) are automatically updated to reflectthose changes.

FIG. 6 illustrates another embodiment of the system that allows a mobilehandset 20 to share content among a plurality of computing deviceswherein the mobile handset has the content store 71 and playlists 72. Asshown, the system permits the mobile handset 20 to synchronize itscontent with a plurality of computing devices 101, 102, . . . , 10 n andeach computing device maintains a content store of the content on themobile handset. For example, in a family in which the different familymembers each have their own computing device, the mobile handset of aparticular family member can be synchronized to the multiple computingdevices so that the content purchased by each member of the family canbe shared. Similarly, the system permits multiple mobile handsets tosynchronize their content with a single computing device (such as mightbe the case of a family) or multiple mobile handsets can synchronizetheir content with multiple computing devices. Thus, the system permitsthe computing devices to effectively share content between the computingdevices.

FIG. 7A illustrates a piece of content 80 segmented into smaller pieces.In most mobile handsets, it is not possible to download an entire pieceof content (or the downloading of the entire content causes anunacceptable delay in the user experience) so that the piece of contentis segmented into segments, such as segments 1-8, in order to downloadthe segments to mobile handset. For example, the system is able todownload the segments in sequential manner and therefore begin to playthe piece of content prior to the entire piece of content beingdownloaded to the mobile handset that provides a better user experience.A mobile handset, depending on the type of mobile handset, may have aprogressive download mode. In the progressive download mode, the mobilehandset can start the download of the segments and then start to playthe content while the remainder of the segments of the content aredownloaded to the mobile handset. If the mobile handset is capable ofprogressive downloading, then the downloading of the content to themobile handset is straight-forward. However, if the mobile handset doesnot support progressive downloading (which is the case for most mobilehandsets such as mobile phones), a buffering method is used to permitthe segmentation of the content and then the downloading of the segmentsof the content.

FIG. 7B illustrates a method for downloading/streaming content to amobile handset that does not support progressive downloading. When themobile handset does not support progressive downloading, the mobilehandset does not permit any download into a buffer while any portion ofthe content is being played from the buffer. The mobile handset 20includes the application, as described above, that manages the contenton the mobile handset and displays the user interface shown in FIG. 4.In the embodiment in which the mobile handset does not supportprogressive downloading, the application may also segment a memory spaceof the mobile handset into a first buffer A and a second buffer Bwherein the downloading of the segments of the content occurs byping-ponging between the first and second buffers. In particular, asshown in FIG. 7B, a new piece of content (having segments 1-8 in thisexample) has its first segment downloaded into the first buffer and thenthe segment is played from the first buffer. While the segment ofcontent is being played in the first buffer, the next segments of thepiece of content (which must include the first segment to maintain thefile integrity and download the file header) of the piece of content isdownloaded to the second buffer B (segments 1-3 in this example). Then,when the first segment is completed, the content in the second bufferstarting at segment 2 is played. During the switch from the first bufferto the second buffer, a 20 ms silence occurs but it is not noticeable bythe user. As the segments of content are being played from the secondbuffer B, addition segments (segments 4-6 in this example) aredownloaded to the first buffer A (along with the prior segments tomaintain content file integrity and download the file header). When theplaying of the second and third segments is completed, the mobilehandset switches back to the first buffer A so that segments 4-6 can beplayed. While the segments in the first buffer A are being played, thelast segments of the piece of content (along with the prior segments tomaintain content file integrity) are downloaded into the second bufferand the mobile handset then plays the remaining segments from the secondbuffer once segments 4-6 are completed so that the mobile handsetping-pongs between the first and second buffers. The use of the twobuffers results in a better user experience since the only silence gapsare approximately 20 ms gaps that are not noticeable by the user andpermits streaming of the content. Without the two buffers, a mobilehandset that does not support progressive downloading: 1) must wait toplay the content until it is completely downloaded (which takes toolong); or 2) introduces a pause (2 seconds or more) each time that themobile handset needs to download the next segments of the content. Inaddition, a mobile handset that does not support progressive downloadingand does not have the two buffers cannot be adaptive to bandwidthchanges in the network and thus cannot take advantage of good networkcoverage and good network speed to provide a better user experience.

In another embodiment, the memory space of the mobile handset may bedivided into the first and second buffers (as described above) and athird buffer wherein the segments of the content are downloading intothe third buffer so that the third buffer has all of the currentlydownloaded segments of the content (or all of the segments of thecontent if the downloading is completed).

The mobile handset application may also include a mode in which theapplication, when the user is playing a playlist for example, looksahead in the playlist and downloads the next piece of content in theplaylist (if it is not already on the mobile handset) in a streamingmanner wherein the first piece of content will have the 20 ms silencegaps (due to the streaming and ping-ponging between the buffers), butany subsequent pieces of content will not have the silence gaps sincethe subsequent content may be pre-downloaded in the entirety to themobile handset.

The mobile handset/application of the mobile handset may also include an“airplane” mode in which the mobile handset and application determineswhen the mobile handset is connected to the network (either the wirelessnetwork or the link). When the application determines that the mobilehandset does not have any connection to the computing device 10, theapplication does not display any content that is only on the computingdevice 10, but permits the user to play the content already stored onthe mobile handset. However, when the mobile handset is again connectedto the computing device 10, the content on the mobile handset and on thecomputing device (shown in FIG. 4 above) is again shown to the user.

FIG. 8 illustrates a network aware mobile handset application of thecontent sharing system. As with the system shown in FIG. 5, the mobilehandset 20 may include the content store 71, such as a database, thatmay include one or more playlists 72 and the computing device 10 may thecontent store 74, such as a database, and one or more pieces of content75. The mobile handset may further include the content application thatis executed on the mobile handset. In this embodiment of the system, thecomputing device 10 or device 22 may have one or more links 24, 26 thatallows the mobile handset 20 to exchange data and information with thecomputing device 10 or device 22. The link, in this embodiment, may beone or more different links that each have different characteristics.For example, the links may be cellular/mobile or 3G network 90, awireless computer network 92 and a Bluetooth network 94. Each of theselink have different characteristics such as cost to use, bandwidthavailable and download speed and protocol. For example, a 3G network isexpensive, requires a 3G enabled mobile device and has very fastdownload speeds, a wireless computer network may be free, require a WLANcard or circuit and has a slower download speed as compared to the 3Gnetwork.

In the network aware mobile handset application of the content sharingsystem, the application on the mobile handset has a behavior (when andhow its uses each different link when available and how it synchronizescontent with the computing device 10 or device 22) that changes based onthe particular link that is available and accessible to the mobilehandset. For example, the application on the mobile handset may beconfigured to download any and all content not already on the mobilehandset automatically whenever the mobile handset can access a free linkand also configured to only download the next piece of content as neededwhen the mobile handset has access only to an expensive link, such as3G. As another example, the application on the mobile handset may have adormancy timer to turn off network access to an expensive link until abutton/user action reactivates the link access. As another example, theapplication on the mobile handset may disable any content prefetch whenthe mobile handset can only access an expensive link. As anotherexample, if the user has selected to download a movie onto their mobilehandset, the application may stream at a minimum speed when the mobilehandset has access only to an expensive link, but may then download theentire movie onto the mobile handset when the mobile handset has accessto a wireless computer network which is low cost or free. Thus, theapplication in the mobile handset has behaviors that change depending onthe link access of the mobile handset.

In the embodiments described above, the content system may additionallyprovide digital content data aggregation. In particular, the system mayinclude a unit/device/module that can aggregate data obtained from userswhen they upload their digital content into the cloud or computer. Thisdata can include web interaction data (data about the user's browsing,etc.), popularity data, other third party data, playlist information,song playback information (e.g., time of last playback, number of timesplayed over past month, etc.), user profile information (e.g.,demographic information), metadata for each piece of digital content(e.g., artist name, title of song, cover art, etc.), lyrics, synchinginformation for the lyrics that can be used to display the lyrics in asynchronized fashion with the digital content, and a digital fingerprintfor the song (which is a representation of the digital data constitutingthe song). In addition to data about the digital content from the user,the content system may also gather third party data that can be combinedwith the user data to enhance the overall user experience of the contentsystem. For example, the system may gather song popularity informationthat is generated by a third party. The data can be aggregated in adatabase and can be used as a basis for providing additional services tousers. The services may include: recommendations, lyric synching, socialnetworking, digital fingerprinting and others.

Recommendations: Using the data stored for the user (in the cloud orcomputer), the system may generate recommendations for the user. Inparticular, the store for the digital content may include playlists fromnumerous users. These playlists provide a correlation between pieces ofdigital content, since the songs on that playlist have something incommon—for example, the user who created the playlists likes all ofthose songs, or those songs all fall within the same genre or othercategory. This correlation information can be used to generaterecommendations. For example, if several playlists contain both Song Aand Song B, and a particular user has Song A but not Song B, arecommendation engine of the content system can recommend Song B to thatuser. Furthermore, the recommendations generated by the content systemmay be based on digital content of other users as described above aswell as digital content of the user. The recommendation feature isdiscussed in greater detail below.

Lyric Synching: In the current art, service providers can offer lyricswith audio or video content for that, for example, the words to a songcan be displayed on a mobile device when the song is playing. Oneconstant challenge is to synchronize the lyrics with the words in thesong so that the right lyrics appear right when the same words are beingsung. Certain applications allow a user to “click” when the next word inthe displayed lyrics is sung so that the system can better synchronizeitself. Using the content system, all synching information for a givenpairing of digital content and lyrics is aggregated by the contentsystem which then performs a normalization process on that pairing todampen the affect of the “outlier” data, e.g., synchronizationinformation that is significantly different than the average of thesynchronization information collected from all users for that pairing.For example, the system may use a deviation process in which line byline synchronization is performed and the standard deviation isdetermined to remove outlier data which results in bettersynchronization of the music to the lyrics.

Social Networking: The content system may also use the uploadedplaylists for each user to assist in social networking. For example, thecontent system can determine that two users have similar musical tastesbased on their playlists and then could introduce a user to a differentuser based on the similarity in musical tastes as determined byanalyzing their playlists. The content system would do this introductionbecause the content system has an API that allows it to interact withvarious different social networking systems or may have its own socialnetworking/community system. The content system also can be used torecommend music e.g., once it determines a similarity, it can makerecommendations to User A based on User B's playlists, such as “User Blistens to Song X but you do not; would you like to try it?” An exampleof a community user interface of the content system as shown in FIG. 15wherein the community is within the content system and permits, amongother things, personal profiles, connection to social networking sites,such as Facebook, Twitter and MySpace, and the user to share commentsand playlists with other members of the community. In addition, thecontent system may also compare users who have a 90% match in theircollections (macro level match) and connect those users to each other.

Digital Fingerprints: Currently, each piece of digital content can beprocessed to create a digital “fingerprint” for the song, which is atype of unique identifier that is based on the digital content and isuseful in ensuring that copyrights are not violated and that appropriatelicense fees are paid. If users have digital fingerprints for theirsongs, these fingerprints can be aggregated in a database as well by thecontent system. These fingerprints can be used for several purposes bythe content system. For example, the fingerprints can be used to verifythe ID3 tags for a song because, if 80% of all 1D3 tags have the samefingerprint, then that fingerprint is likely accurate and those ID3 tagsare likely accurate. In one embodiment, the fingerprint can be an ASCIIstring consisting of up to 16K bits and can be based on the entire pieceof digital content and not just a portion of it. The fingerprint of theentire piece of digital content can be used by the system to identifythe digital content of other users.

Other: The aggregated data also can be used for other purposes. Forexample, if a user searches for songs by Artist A, a store of thecontent system can determine what the five most popular songs by ArtistA are (based on the data stored in the database that was collected fromusers), and it can then show those song in order of popularity among allusers represented in the database. The content system also allows a userto search by artist or album and then download (purchase) some/all ofthe songs for a particular artist or album. An example of a userinterface for on-demand digital content of the content system thatallows the user to browse and search a library of digital content, playany piece of digital content and add any pieces of digital content toone or more playlists is shown in FIG. 14.

In addition, since the content system may be used to store the digitalcontent for multiple devices 20 of the user as shown in FIGS. 2A and 2B,the digital content lists for each device 20 may be synchronized so thatthe list of digital content on each device is constantly updated basedon the store of digital content in the content system. In addition, whenthe user buys a new device that has digital content capabilities, thecontent system may, automatically or on user command, download thedigital content list to the new device. The content systems describedabove also permit two-way synchronization in that digital content (allor a subset) is synchronized from the content store to each device 20and the digital content on any device 20 may be synchronized back to thecontent store.

The content system may also provide a playlist creation sub-system inwhich digital content of the user may be used to seed a new playlist ofdigital content. Alternatively, a playlist can be generated from a setof recommendations provided to the user. The playlist creation unit mayoffer a first level of service and an on-demand/interactive level ofservice. The first level of service may provide playlists generatedbased on a user's digital content. The on-demand/interactive level ofservice may provide playlists based on any digital content on a playlistand allow the user to add or delete digital content/playlists.

The content system may also provide streaming download or progressivedownload to the devices 20 of the digital content instead of thedownload of the entire piece of digital content. If the device canaccommodate progressive download, then progressive download is used. Ifthe device cannot use progressive download, then streaming download isused. Now, examples of the user interface of the content system aredescribed in more detail.

FIG. 9 illustrates an example of a computer interface 100 of the contentsystem that allows synchronization of digital content and adding digitalcontent. This computer interface can be seen by accessing the contentsystem using a computer, for example. As shown in FIG. 9, the system mayhandle movies, music and ringtones wherein the user interface has tabsthat can be chosen by the user to view the pieces of digital content ofthe user associated with each type of digital content. The userinterface also may have a lyric portion 102 that displays the lyrics ofthe digital content being currently played by the user. The userinterface also may have a digital content list portion 104 that showsthe digital content, the digital content playlists and the various listsof the different types of digital content which may be selected by tabsin the user interface. Each list of digital content may include thefollowing fields including: a name of the digital content, an artist ofthe piece of digital content, an album that contains the piece ofdigital content (for music), a genre assigned to the digital content (ifany), and a rating of each piece of digital content (if any).

FIG. 10 illustrates an example of a web interface 110 of the contentsystem that allows synchronization of digital content wherein thisillustrates an example of a user interface when the user logs into thecontent system over the web. As shown, the user interface has the sameportion 104 as with the computer user interface and also has a condenseddigital content control portion 112 that allows the user to start, stop,play, etc. digital content, share content, watch the video associatedwith the digital content (for music) and see/sync the lyrics with thedigital content (for music). The digital content portion 104 in thisuser interface also has a time period of the digital content field shownthat may also be present in the user interface shown in FIG. 9. For bothof the user interfaces of FIGS. 9 and 10, the content system also allowsthe user to purchase digital content using, for example, the userinterface shown in FIG. 11. In addition, the content system allows theuser to listed to a personal radio station as shown in FIG. 12.

FIG. 13 illustrates an example of a television interface of the contentsystem wherein the user can interact with the content system from an IPenabled television and thus interact with the digital content. FIGS. 16Aand 16B illustrate two examples of a user interface of the 15 contentsystem on a device, such as a RIM Blackberry device. FIG. 16A showssynching of digital content occurring while FIG. 16B shows the userinterface when a piece of digital content being played. Furthermore,FIG. 17 illustrate examples of a user interface of the content system onseveral different devices including the RIM Blackberry, Motorola Droidand the Apple iPhone.

FIG. 18 illustrates an example of the user interface for songs/playlistsavailable to a device 20 which allow a user of the device to requestdigital content (songs), playlists (shown in FIG. 18), artist playlistsand album playlists from the digital content stored on the contentsystem. Some of the digital content may be already stored on the deviceand the remainder can be downloaded wirelessly or over a USB cable as itis needed by the user. FIG. 19 illustrates an example of the userinterface for a digital content player on a particular device thatallows the user to control playback of the current playing digitalcontent and have additional features specific to the digital contentbeing played by the user. FIG. 20 illustrates an example of the lyricuser interface for a digital content system on a particular device inwhich the user is viewing the lyrics as a song is being played by theuser.

For certain devices 20, there may be some additional features of thecontent system. For example, the content system may enable livewallpaper (See FIG. 21 for example) in which the wallpaper may be coverart from the music in the content system. The background may beresponsive to touch and change slowly when no music is playing andanimate during song transitions. The certain devices may also have adesktop widget (See FIG. 22) that allows the user to control the playingof the digital content. Furthermore, the devices may integrate thecontent data into a quick search (See FIG. 23) to find pieces of digitalcontent on the device or available on the computer/cloud. FIG. 24illustrates an example of a docked playback client of the digitalcontent system on a particular device wherein the user interface has alandscape layout. The device may also integrate the content system intoa notification service (see FIG. 25 for example) in which the user hasquick access to the current application as well as new/changed contenton the computer/cloud.

Social Networking

Other embodiments involve social networking. FIG. 27 illustrates animplementation of an embodiment of a system 210 for content socialnetworking. The system may be implemented as a hardware/software basedsystem in this implementation. The system 210 may include one or moremobile handsets 212 (such as a first mobile handset 212 a used by User Aand a second mobile handset 212 b used by User B as shown in FIG. 27)wherein the system allows the users to socially network/flirt with eachother using pieces of content. Each mobile handset 220 may be aprocessing unit based device with sufficient processing power, displaycapabilities, connectivity capabilities and memory to interact with thesystem. Each mobile handset, for example, may be a PDA, a mobile phone,a wireless email device (such as the Blackberry or iPhone) that may ormay not have phone capabilities, handheld digital content devices (suchas iPods and the like) or other handheld device that are capable ofdownloading and playing digital content.

The system may further comprise a computer 214, such as one or moreserver computers, that can be connected to the one or more mobilehandsets over one or more links 215. The links can be any type of link,such as the Internet, and can be hardwired, wireless, or somecombination of the two. When the link is wireless, it can be, forexample, a cellular telephone network, a WiFi network (such as an 802.11network), a wireless data network (such as EV-DO or EDGE), or any otherwireless networks. The links 215 allows the one or more mobile handsets212 to exchange data and information with the computer 214 includingdigital content as described below in more detail. The computer 214 mayhave the appropriate one or more interfaces/circuitry that allow themobile handsets to connect to and interact with the computer 214.

Each mobile handset 212 may further comprise a storage device 216, suchas a hard disk drive, flash memory etc. that may be volatile ornon-volatile, that stores one or more pieces of digital content 218 onthe mobile handset 212. The digital content may be a song, a video, apicture, a podcast, a radio feed, an application, a document, musiclyrics, artists' bios, concert information, or any other piece ofdigital content, and the storage device 216 may store one or more ofthese different types of digital content. Each mobile handset may alsoinclude a display 220 that allows the user to scroll through a userinterface to select a piece of digital content to interact with. Eachmobile handset may also include an interface (not shown) that allows theuser to plug in a set of earphones, speakers etc into the mobile handsetas well as a processing unit (not shown) that controls the operation ofthe mobile handset and a power source (not shown) to power the circuitryof the mobile handset. Each mobile handset may also include a inputdevice that allows the user to interact with the mobile handset andconnectivity circuitry (not shown) that allow the mobile handset toconnect to and interact with the computer 214. For a wired link 215, theconnectivity circuitry may be an interface that allows a conductor to beplugged into the mobile handset. For a wireless link 215, theconnectivity circuitry may be wireless circuitry that allows the mobilehandset to interact wirelessly with the computer 214.

The computer 214 may further comprise one or more processing units,storage devices and interfaces (not shown) as well a content networkingunit 230 (implemented as a plurality of lines of computer code that areexecuted by the one or more processing units of the computer 14 in thisembodiment) that performs various content social networking as describedbelow in more detail. The computer 214 may further comprise a contentstorage 232 (implemented as a plurality of lines of computer code thatare executed by the one or more processing units of the computer 214 inthis embodiment) that stores content and allows a user to catalog andorganize the digital content of the user. The content storage 232 mayalso have a listing of the pieces of digital content for each user (alibrary) which are pieces of digital content that the user has therights to interact with. The content networking unit 230 may furthercomprise a content identification unit 234 (implemented as a pluralityof lines of computer code that are executed by the one or moreprocessing units of the computer 214 in this embodiment) that identifiescontent received by the computer from the one or more mobile handsets212 and/or determines that the received content is or is not alreadystored in the content storage 232. The networking unit may furthercomprise a network unit 236 (implemented as a plurality of lines ofcomputer code that are executed by the one or more processing units ofthe computer 214 in this embodiment) that determines the networkingaction to perform in response to the received content as described belowwith reference to FIG. 28. The content networking unit 30 thus mayimplement social networking among its users based on pieces of digitalcontent as described below. Now, an example of the content socialnetworking implemented by the system shown in FIG. 27 is described withreference to FIG. 28.

FIG. 28 illustrates an example of a method 250 for content socialnetworking that may be implemented using the system shown in FIG. 27,but may also be implemented using other systems. In the method, a userof a first mobile handset may interact with a piece of digital content(252) such as by the user playing/viewing the piece of content orbrowsing the piece of digital content. When the user interacts with thepiece of digital content, the user optionally may also identify a person(a second user) who the user wishes to socially interact with/flirtwith. The piece of digital content (or an identifier) and optionally theidentity of the second user are sent to the computer 214 shown in FIG.27. The computer 214 identifies the piece of digital content (by usingthe content identification unit 34 of FIG. 27, for example) and thenprovides a service associated with the identified piece of digitalcontent to a user of a second mobile handset (254) such as by using thenetwork unit 236 of FIG. 27. For example, the service may allow thefirst and second user to social network/flirt with each other using thepiece of digital content based on the provided identifier of the seconduser. Alternatively, users may agree to socially network using thesystem and then the system will display what pieces of digital contenteach user, who agreed to socially network, is interacting with so thatanyone can then communicate with the other users or with the system. Asanother alternative, the system may select one or more users to whom thereceived piece of digital content is to be shared based on variouscriteria. The criteria can include geographic proximity, membership in asocial network or a “friends list,” or belonging to a common service ornetwork. The criteria can select from a private group (e.g., a user'ssocial network) or a public group (e.g., all wireless customers ofSprinte).

The service associated with the piece of digital content may be varied.For example, the computer 214 shown in FIG. 27 may send the piece ofidentified digital content to the second user with an indication thatthe piece of digital content originated from the first user. As anotherexample, if the identified piece of digital content is also in thelibrary of the second user, then the computer 214 shown in FIG. 27 mayprovide an indication that the piece of digital content originated fromthe first user and allows the second user to interact with theidentified piece of digital content (256) such as by using the secondmobile handset. As another example, if the identified piece of digitalcontent is not in the library of the second user (so the second userdoes not have rights to interact with the identified piece of digitalcontent), then the computer 214 shown in FIG. 1 provides an indicationthat the piece of digital content originated from the first user andallows the second user to purchase the identified piece of digitalcontent (256) such as by using the second mobile handset so that thesecond user can then interact with the piece of digital content. In thismanner, the system shown in FIG. 1 may be used by the users to socialnetwork/flirt with each other using a piece of digital content. Thiscommunication can occur through SMS messaging, communication mechanismsoffered by a social network such as Facebook®, or communicationmechanisms offered by an application running on the mobile handset.

FIG. 29 illustrates an implementation of another embodiment of thesystem 10 for content social networking that incorporates geography. Inthis figure, elements with the same reference numerals as shown in FIG.27 are the same and perform the same operations and functions andtherefore will not be further described with respect to FIG. 29. In thisimplementation, the location of each user may be used to determine whichusers are able to social network/flirt with other users or the systemmay select the other users to social network/flirt with based on thelocations of the users as described below with reference to FIG. 30. Toimplement this embodiment of the system, each mobile handset 212 has aunit 219 that determines the location of the mobile handset so that thelocation of the mobile handset can be transmitted to the computer 214.As an example, the unit 219 may be known GPS circuitry and software orit may be software that determines the position of the mobile handsetbased on the wireless link towers. The content networking unit 230 mayfurther comprise a unit 238 (implemented as a plurality of lines ofcomputer code that are executed by the one or more processing units ofthe computer 214 in this embodiment) that receives the locationinformation from the mobile handsets, processes the location informationas needed and supplies the location information to the network unit 236.The network unit 236, in this embodiment, may then use the locationinformation of each mobile handset to determine which users to socialnetwork together using the piece of digital content. In particular, itis more likely that users in a particular geographic area (same town,for example) are more likely to social network and date each other thanusers in disparate geographic areas. Thus, as shown in FIG. 30, themobile handsets in a first geographic area 270 may be socially networkedtogether using the system while users in the outer geographic area 272are not socially networked to each other due to the distance between theusers. The system shown in FIG. 29 may also be used to determine thetype of digital content being interacted with by users in a particulargeographic area and then socially networking those users in theparticular geographic area together as described above.

Alternatively, the system can determine the digital content that usersin a particular geographic area are interacting with and then displayrepresentations of the users and their digital content to the otherusers of the system. For example, in FIG. 31, mobile handsets 212 a, 212b, and 212 c are within a first geographic area 270. The users operatingthose mobile handsets already are part of an existing social network,such as through Facebooke. The system shown in FIG. 29 will recognizethat handsets 212 a, 212 b, and 212 c are being operated by members ofan existing social network and will then transmit information regardingone or more of them to one or more of the others. For example, mobilehandset 212 a at a particular moment in time may be associated withcontent 280. Content 280 could be a ringtone, music clip (such as athvorite song), video clip, artwork or other media content. The systemshown in FIG. 29 will transmit this information to mobile handset 212 b(for example), and mobile handset 212 b can then show its user thatmobile handset 212 a and its user are associated with content 280 andare located at a particular geographical location. For example mobilehandset 212 b can generate a map showing first geographic area 270, thelocation of mobile handset 212 a within that first geographic area 70,and information regarding content 280 associated with mobile handset 212a (for example, a pop-up window associating mobile handset 212 a with amusic clip or a depiction of a music clip that is currently playing onmobile handset 212 a). In this manner, a member of a social network canlearn which members of their social network are in close physicalproximity to him or her, and also can learn what those members are doingat the present time by receiving information about content associatedwith the mobile handsets operated by those members at a particularmoment in time.

FIG. 32 shows an exemplary graphical user interface for a mobilehandset. It shows display screen 300 of mobile handset 212 b. Displayscreen 300 generates a map 310 showing the geographic location of mobilehandset 212 a and mobile handset 212 b. Display screen 300 displayscontent information 320 concerning mobile handset 212Et. In thisexample, the mobile handset 212 a is playing “Ode to Joy” at thatparticular moment in time (for example, as a music clip, ring tone,streaming audio, etc.). Content information 320 shows information aboutthat content, for example, the title (“Ode to Joy”), cover art, artistinformation, metadata, etc. Content information 320 optionally includesselector 130 that permits the user of mobile handset 212 b to perform anaction relating to mobile handset 212 a, the user of mobile handset 212a, and/or the content associated with content information 320. Forexample, selector 330 can include a button that permits the user ofmobile handset 212 b to purchase or sample the content associated withcontent information 220 (for example, to listen to a clip of “Ode toJoy), or to communicate with mobile handset 212 a (for example, to sendan SMS message, email, or a message via a social networkingcommunication mechanism). One benefit of this embodiment is that theuser of mobile handset 212 b will know that the user of mobile handset212 a is nearby and will learn what he or she is doing at that moment intime with regard to digital content.

Although parts of the preceding discussion have focused on socialnetworks, the same concepts can be applied to other groups orcharacteristics of users. For example, the same actions describedpreviously with reference to FIG. 31 can be applied to all users whosubscribe to the same service (e.g., a streaming radio service) or whohave other characteristics in common (e.g., all users who haveidentified themselves as fans of a particular musical group), instead ofall users who are part of the same social network.

Recommendation Engine

In other embodiments, a recommendation engine is used. With reference toFIG. 33, computing device 28 of previous figures is depicted. As statedpreviously, computing device 28 may be a computing cloud (with aplurality of processing unit based devices, storage devices, etc.).Computing device 28 comprises a content store 400, such as a database.Content store 400 optionally creates and maintains data structures, suchas a database table, for each user who has registered with or isotherwise known to computing device 28. For instance, data structure 401can be assigned to User 1, data structure 402 can be assigned to User 2,etc. In this manner, a data structure can be assigned to each of the NUsers, where N is the total number of users of a particular serviceoffered by computing device 28.

As an example, when the relevant digital content is music, each datastructure, such as data structures 401, 402, On, optionally can includefields such as the following: an ID for the user, playlists (includingthe name of the playlist, other identifiers for the playlist, titles ofthe songs on the playlist, and other identifiers for the songs on theplaylist), metadata for all stored songs, ratings for each song (whetherby that user, other users, or an aggregate of users), the frequency withwhich the particular user has played each particular song (e.g., 8 timesover the past 7 days), the time elapsed since the particular user hasplayed each particular song (e.g., 256 minutes), the timestamp of thelast time the particular user played each particular song, and IDs forother users of the service offered by computing device 28 who are withinthat particular user's social network (such as within Facebook0).Optionally, instead of playlists, the same approach can be used to trackpersonalized radio stations or other collections of content accessed byeach user. In addition to music, data structures can be created forother types of digital content as well (such as video, TV, movies,commercials, advertisements, etc.) that may or may not have similarfields to those shown in FIG. 33.

Identification information for persons who are within a particularuser's social network can be readily obtained using publicly known APIsoffered by providers of social networks. For example, computing device28 can communicate with computing device 405 that is associated with theservice that provides a social network (such as a server for Facebookt).This communication can occur via an API or other communicationmechanism. Once obtained, the identification information for personswithin a particular user's social network can then be compared toinformation provided to computing device 28 by all users, and computingdevice 28 can then determine which users are within the same socialnetwork.

With reference to FIG. 34, in another embodiment, content store 400optionally creates and maintains data structures, such as a databasetable, for sequences of digital content that it receives and offers toits users. Examples of such sequences can include radio feeds or radiostations, video feeds or video stations, TV content, collections ofcommercials or advertisements, or other sequences of digital content.

For example, computing device 28 can be configured to receive livecontent feeds from content sources 411, 412, 413, and others (that maybe, for example, radio sources). In one example, the Radio Sources 411,412, 413, and others are computing devices that send live radio feedsover the Internet using standard HTTP communications and standardInternet radio formats such as SHOUTcast or Icecast. In this example,when the sources are radio stations, data structure 421 can be assignedto Radio Source 411, data structure 422 can be assigned to Radio Source412, etc. In this manner, a data structure can be assigned to all Mcontent sources, where M is the total number of content sourcesmonitored or received by computing device 28. Each data structure, suchas data structures 421 and 422, optionally can include fields, when thecontent sources are radio sources, such as the following: an ID for theradio source or radio feed, metadata for all songs played on that radiosource or radio feed (including a running log of all songs played),ratings for each song (whether by that particular user, other users, oran aggregate of users), the frequency with which the radio source orradio feed has played (or streamed, downloaded, transmitted, etc.) eachparticular song (e.g., 14 times over the past 7 days), the time elapsedsince the particular radio feed has played (or streamed, downloaded,transmitted, etc.) each particular song (e.g., 378 minutes), thetimestamp of the last time the particular user played each particularsong, and IDs for users who have listed to the radio source or radiofeed and related metadata. Optionally, each data structure can beconfigured to store data for only the last R songs played (or streamed,downloaded, transmitted, etc.), where R is an integer chosen tocorrespond to an approximate time period of interest. For example,because musical popularity changes very quickly, R may be chosen to be1000, as 1000 songs might be the approximate number of songs played inone week by a radio source. Using this approach, the data structureswould contain data that reflects the most current trends in popularityof particular songs and radio feeds. The data can be collected from alldevices used by each user, such as in the configuration previouslydescribed with reference to FIG. 2B. Instead of radio sources or radiofeeds, data structures can be created for virtually any type of sequenceof content, such as video stations or video feeds, TV stations, etc. Itshould be evident that content store 400 can collect a vast amount ofdata that indirectly reflects the relative popularity of each particularpiece of digital content. With reference to FIG. 35A, content store 400is accessed a by recommendation engine 430. Recommendation engine 430comprises a computing device that runs an application or lines of codethat perform the recommendation functionality described herein.Recommendation engine 430 optionally can be within computing device 28(e.g., as a component within a cloud system), or it can be separate fromcomputing device 28.

Recommendation engine 430 receives one or more inputs and creates arecommendation 440 as an output in real-time. The inputs can includedata stored in content store 400 as described previously with referenceto FIGS. 33 and 34. For example, if User 1 has a social network throughFacebook®, recommendation engine 430 can compare the playlists of User 1(as stored in data structure 401) to the playlists of other users whoare within User 1's social network. In one embodiment, recommendationengine 430 can find the user within User 1's social network who hasplaylists that most closely match those of User 1 (either on aplaylist-by

playlist basis or in the aggregate). For example, suppose that User 2 iswithin User 1's social network, and that User 1 has a playlist X andUser 2 has a playlist Y and 80% of the songs on playlist X are onplaylist Y and that this is the closest match among all of User 1'splaylists and all the playlists of all users within User 1's socialnetwork. Recommendation engine 430 will identify playlist Y as being aclose match to one of User 1's playlists (playlist X).

Recommendation engine 430 will then identify the songs on playlist Ythat are not on playlist X, and it can then recommend one or more ofthose songs to User 1. To enhance the social networking experience,recommendation engine 430 can inform User 1 that User 2 likes thatparticular song or songs, for instance, with a message that says, “Yourmusical tastes are similar to John [User 2]. He likes ‘Firework,’ whichis not in your library. Click here to listen to or purchase it.” Inanother embodiment, recommendation engine 430 can ask User 1 if User 1wants to send a recommendation to User 2, as a mechanism for enhancingthe social networking experience. For example, recommendation engine 430can send a message to User 1 that says, “Based on the musical tastes foryou and User 2, we think User 2 would like ‘Firework,” which is in yourlibrary but not User 2's. Click here to send a recommendation to User 2for that song.” If User 1 clicks the selection field, recommendationengine 430 would then send the recommendation to User 2 and indicatethat it came from User 1. In yet another embodiment, recommendationengine 430 can perform the same type of comparisons described above forother digital content, such as other audio content, movies, other videocontent, commercials, or any other digital content.

Recommendation engine 430 can be configured to apply different weightingcoefficients to each element considered in making a recommendation. Forexample, it can apply a different weight to each of the elements storedin the data structures described previously with reference to FIGS. 33and 34. It can then apply the coefficients to generate a number thatreflects a raw value of a particular item, and it can then recommend theitem with the highest raw value. The social network or social graphitself can be used as a weighting factor by recommendation engine 430.For example, if a particular song is on the playlist of a member of aparticular user's social network, then recommendation engine 430 willgive it a greater weight in deciding what to recommend than would be thecase had that member not been the particular user's social network. Anexample of a formula that can be used to generate the raw number foreach item as to User X (to determine which item to recommend to User X)is the following:

For Song Y:

Coefficient Item 1.0 Percentage of Number of Times Song Y was Listenedto By Members of User X's Social Network Compared to All Songs WithinLast 24 Hours (normalized to scale of 0.00 to 1.00) 0.5 Percentage ofNumber of Times Song Y was Listened to By Users Who are Not Members ofUser X's Social Network Compared to All Songs Within Last 24 Hours(normalized to scale of 0.00 to 1.00) 1.0 Average Rating of Song Y ByMembers of User X's Social Network (normalized to a scale of 0.00 to1.00) 0.25 Average Rating of Song Y by Users Who are Not Members of UserX's Social Network (normalized to a scale of 0.00 to 1.00) 2.0Percentage of Radio Stations that Have Played Song Y In Last 24 Hours(normalized to a scale of 0.00 to 1.00)

In this example, each coefficient would be multiplied by itscorresponding item, and the results would be summed to create a rawvalue. The item with the highest raw value that is not already in UserX's library (or playlist, etc.) would be recommended to User X. Thesecoefficients are merely exemplary and could be chosen to place greateror lesser weight on each item. As will be apparent in this example,greater weight can be placed on the activities of members of User X'ssocial network compared to the user base in general.

In another embodiment, recommendation engine 430 can instead createrecommendations using data collected from all users by using a vectormethod that is well-known in the art and is commonly used forrecommendations made by retail websites. With reference to FIG. 35B, ina different embodiment, recommendation engine 430 comprises a firstengine 431 which generates recommendations based upon a first set ofusers and a second engine 432 which culls the results of first engine431 based upon a second set of users that is a sub-set of the first setof users. For example, first engine 431 might perform actions based ondata from all users of a service offered by computing device 28, andsecond engine 432 might cull the results from first engine 431 byselecting results that correspond only to members of the particularuser's social network. In this particular example, second engine 432would comprise a social graph filter. Thus, in this embodiment,recommendation engine 430 would find the top users who most closelymatch the taste of a particular user, and then compare those usersagainst the members of the particular user's social network, and if amatch is found, issue a recommendation based on the member with thecloset match.

In another embodiment, recommendation engine 430 can recommend asequence or source of digital content for a particular user. Forexample, if a playlist or the total collection for User I has a closeoverlap with music recently played by an Internet radio source or radiofeed (such as by comparing the last Q songs that User 1 has listened towith the last R songs that each radio source or radio feed has playedand identifying the radio source or radio feed with the largest numberof songs that also were listed to by User I), recommendation engine 430might recommend that radio source or radio feed to User 1, perhaps witha message that says, “Based on your musical taste, we think you wouldlike the WABC radio station. Click here to access it” on the userinterface of the user's computing device

In another embodiment, recommendation engine 430 can determine the mostpopular song listened to or played by all users within a particularuser's social network that the particular user does not yet have in hisor her collection. It can then recommend that song to the particularuser, perhaps with a message that says, “The most popular song listed toby people in your social network that you do not have in your collectionis ‘California Girls.’ Click here to listen to or purchase it” on theuser interface of the user's computing device.

Recommendation engine 430 and computing device 28 can be utilized toprovide metrics to a particular user regarding patterns in that user'sinteractions with digital content. For example, because computing device28 captures metadata for all digital music listened to by a particularuser, computing device 28 can provide a graph, pie chart, or otherdescriptive image or data that shows the user's listening habits bygenre, time period of music, or other aspect of the digital music. Forexample, computing device 28 can create a graph that shows the number ofsongs listened to by the user over a certain time period from the 1970s,1980s, 1990s, 2000s, and 2010s. Recommendation engine 430 can them makea recommendation to the user. For example, if that user predominantlylistens to music from the 1970s, recommendation engine 430 might informthe user, “You are stuck in the 1970s. You should listen to Song X, orRadio Station Y,” where Song X is a recently-released song, and RadioStation Y mostly plays “current” music. Computing device also mightprovide the user with a pie chart indicating the proportion of songslistened to by the user over a certain time period that falls withineach genre (Classic Rock, Hip Hop, etc.). Recommendation engine 430 thenmight inform the user, “You like Hip Hop music. You might enjoy Song X,or Radio Station Y,” where here Song X is an R&B song, and Radio StationY mostly plays R&B music. In this manner, the user learns about his orher own listening patterns, and recommendation engine 430 makessuggestions to the user that is designed to broaden that user'slistening experience by exposing the user to music that is different butlikely to be enjoyed by that user based upon correlations identified byrecommendation engine when examining data stored in content store 400collected from other users.

Computing device 28 also can indicate changes in listening patterns overtime. For example, it can show a chart describing a user's listeningpatterns by month, or by year, so that 20 the user can see how his orher tastes have changed over time.

In yet another embodiment, computing device 28 and/or recommendationengine 430 can generate charts or other data regarding the listeninghabits of all users or a sub-group of users (such as users within asocial network). For example, it can send a list or graph of the mostpopular songs within a certain time period (based on, for instance, thesong that was most frequently played over the past week). It also cansend a list of graph of the most popular songs within a certain timeperiod for users within a social network. (“The most popular song amongyou friends this week was ‘Firework.”). This also can be offered forother collections of people (e.g., all students at Stanford University).This is another way of exposing users to new music. In a variation ofthis embodiment, computing device 28 can provide this information tousers by a news feed (such as through Twitter® or other devices), sothat users will be provided with this information in real-time.

Computing device 28 also can inform a user whether his or her musicaltastes are “hip” compared to the all users of computing device 28 or allusers within that particular user's social network. Computing device 28can compare a list of the most popular songs within all users or aparticular user's social network with that particular user's listeninghabits over time. If the user listened to those songs several days orweeks before they became popular, then computing device 28 can informthe user that he or she is a “hip” music listener because he or shelistened to music before it became popular. This will incent users tolisten to music as soon as it becomes available to see if they canpredict popularity.

In another embodiment, recommendation engine 430 or computing device 28can provide a particular user with access to the playlists or othermetadata of other users within that particular user's social network.This would allow, for instance, someone to see which songs their friendsare listening to, and perhaps to have the option to purchase or samplethat music.

In another embodiment, recommendation engine 430 can recommend to aparticular user that they add another user to his or her social networkbased on the metadata collected for each one. For example, if themusical tastes of User I and User 2 are similar (based on a comparisonof their playlists or listening habits) and User 1 and User 2 are not inthe same social network, then recommendation engine 430 can send amessage to User 1 such as “Your musical tastes are very similar to thoseof John [User 2]. Click this link to invite John to your social network”on the user interface of the user's computing device.

In another embodiment, recommendation engine 430 can create a new socialnetwork based on the musical tastes of two or more users. For example,if a collection of users have a substantial overlap in their playlistsor listening habits, then recommendation engine 430 could invite them tojoin a new social network centered around the prevalent type of music(e.g., the Classic Rock User Network).

In yet another embodiment, recommendation engine 430 can recommend anentire set or playlist of content instead of just an individual piece ofcontent. It can generate this set or playlist using the same methodologydescribed previously.

In yet another embodiment, computing device 28 and content store 400 cangather and store information regarding other activities performed byusers, such as links/URLs selected through a web browser or coupons oradvertisements viewed or clicked upon. With reference to FIG. 36, User 1operates device 451, User 2 operates device 452, and User 3 operatesdevice 453. Computing device 28 and content store 400 collectinformation regarding all items selected by each user (such aslinks/URLs, coupons, advertisements, etc.). Content store 400 optionallyincludes a data structure for each user (such as Data Structure 461 forUser 1 and Data Structure 462 for User 2). These data structures caninclude the following fields: User ID, metadata for all links/URLsselected, metadata for all advertisements viewed or selected, andmetadata for all coupons viewed or printed. This data can then beaccessed by recommendation engine 430 to create additionalrecommendations for a particular user, such as websites he or she islikely to enjoy (based on the history of links/URLs selected by otherpersons whose activities closely match those of the user), or coupons oradvertisements he or she is likely to enjoy (again, based on thecorrelation between the user's history and those of other users withsimilar histories). These recommendations optionally can be constrainedwithin that user's social network. For example, a message can be sent toUser 1 stating, “10 of your friends in your social network printed thefollowing coupon for Acme Materials today.”

In yet another embodiment, with reference to FIG. 37, an advertisingengine 470 generates one or more advertisements 480 for a particularuser based at least in part on data received from recommendation engine430 and/or the content store 400. These ads can be chosen based on theonline activity of members of a particular user's social network. Forexample, if Advertisement X was the most popular ad within the socialnetwork (based on times viewed or clicked, etc.), then recommendationengine 430 and/or content store 400 can recommend to advertising engine470 to send Advertisement X to that particular user.

In yet another embodiment, with reference to FIG. 38, computing device28 and content store 400 can gather and store information regardingretail activity. Computing device 28 can obtain data from retaildatabase 471, retail database 472, etc. These retail databases can beassociated with a retail website, a “brick and mortar” store, or anyother collection of retail data. Content store 400 optionally includes adata structure for each item, such as data structure 481 for item 1,data structure 482 for item 2, etc. The data structures 481 and 482 caninclude the following fields: item ID (such as a SKU number), quantitysold in particular time period (e.g., number sold in last 24 hours),elapsed time since last sale (e.g., 3 minutes), average number sold pertime period (e.g., 27 per day over the last 7 days), and IDs of userswho purchased the item and related metadata (date and time of purchase,quantity, etc.). Recommendation engine 430 then can generaterecommendations for retail items based on the data collected (e.g.,“Seven people in your social network have purchased Item X. Click hereto purchase it.”) on the user interface of the user's computing device.

Dynamic Content Verification

Another embodiment involves a variation of the system shown in FIG. 2Aand previously described, and will be described with reference to FIG.2A and FIGS. 39A and 39B. In this embodiment, as in certain previousembodiments, computer 10, device 20, and device 22 contain a list of thedigital content of the user. The user adds digital file 520 to computer10 (step 500). Computer 10 creates an updated list 530, and the new listor the updates are sent to device 22, which also creates updated list530 (step 502). The user later requests digital file 520 on device 20(step 504) using one of the embodiments previously described.

Device 20 requests digital file 520 from device 22 (step 506). Device 22sends a query to computer 10 regarding digital file 520 (step 508).Computer 10 verifies the status of digital file 520 and sends a responseto device 22 (step 510). Step 510 optionally can include running aprocess to determine if the user has legitimate ownership rights todigital file 520, such as by generating a digital fingerprint fordigital file 520 and comparing the digital fingerprint to a database ofknown, verified digital fingerprints to determine if digital file 520was purchased legitimately or if it is an illegal “bootleg” copy. Ifcomputer 10 confirms the positive status of digital file 520 (such as byconfirming that it was purchased legitimately), device 22 sends digitalfile 521 to device 20 (step 512). Digital file 521 contains the sameexact content as digital file 520. However, digital file 521 was alreadystored in device 22 (as might be the case if device 22 contains a largecollection of digital content, such as one might find in an onlinecatalog or music provider), and therefore, digital file 520 need not beuploaded to device 22 from computer 10, which would reduce the waitingtime for the user and would minimize the use of bandwidth betweencomputer 10 and device 22.

Additional detail for an optional implementation of step 510 will now bedescribed with reference to FIG. 40. The concept of a digitalfingerprint was described previously. An additional method and systemfor generating a unique digital ID for a piece of digital content wasdescribed in U.S. patent application Ser. No. 11/874,720, filed on Oct.18, 2007, and issued as U.S. Pat. No. 7,917,083 (“Tang”), on Mar. 29,2011, the content of which is hereby incorporated by reference as iffully set forth herein. Tang discloses a type of digital fingerprintingthat can be used with the embodiments described herein. With referencenow to FIG. 40, computer 10 generates digital fingerprint 550 fordigital file 520 (step 540), using the method and system of Tang or someother known method and system. Computer 10 compares digital fingerprint550 against database 560 containing a plurality of digital fingerprintsfor digital content (step 542). Database 560 can be part of computer 10,or it can be accessed by computer 10 over a network.

For example, known services such as the Gracenote™ service offered byGracenote, Inc., maintain a database of digital fingerprints forcopyrighted music recordings and files and will make its databaseavailable for a fee. When used in conjunction with the Gracenote™service, computer 10 will send database 560 (in this example, a serverassociated with the Gracenote™ service) a digital fingerprint that wasgenerated on computer 10 using an algorithm provided as part of theGracenote™ service, and database 560 will send back a “song key” tocomputer 10. The song key can then be compared to a table of song keyspreviously provided to computer 10 by the Gracenote™ service, and if amatch is found, then computer 10 can conclude that digital file 520 is aconfirmed, legitimate file, and the table can be used to obtaininformation about the song, such as title, artist, recording date, etc.Another known fingerprinting service is Echoprint by The Echo Nest.

Regardless of the exact type of database 560 used, step 542 willindicate if digital file 520 is a file obtained legally or if it is anillegal “bootleg” copy or a file that cannot be identified or confirmedto be legitimate. Finally, computer 10 obtains the result of step 542,which indicates if the digital fingerprint indicates that digital file520 is a legal copy or not (step 546). If digital file 520 is a legalcopy, then device 22 sends digital file 521 to device 20 (step 512,described previously). If digital file 520 is not confirmed to be alegal copy, then device 22 can optionally send a message to device 20indicating that it cannot send digital file 520 or digital file 521 todevice 20 unless the user pays a fee to obtain the appropriate licenserights to that file.

In a variation of this method, computer 10 can instead send the digitalfingerprint 550 to device 22, and device 22 can compare digitalfingerprint 550 against database 560 to determine if digital file 520 isa legal copy.

Another embodiment involves a variation of the system shown in FIG. 2Band previously described, and will be described with reference to FIG.2B and FIGS. 41A and 41 B. In this embodiment, as in certain previousembodiments, devices 20 and computing cloud 28 contain a list of thedigital content of the user. The user adds digital file 520 to a firstone of devices 20 (step 600). The first one of device 20 creates anupdated Ha 530, and the new list or the updates are sent to computingcloud 28, which also creates updated list 530 (step 602). The user laterrequests digital file 520 on a second one of devices 20 (step 604) usingone of the embodiments previously described. The second one of devices20 requests digital file 520 from computing cloud 28 (step 606).Computing cloud 28 sends a query to the first one of devices 20regarding digital file 520 (step 608). The first one of devices 20verifies the status of digital file 520 and sends a response tocomputing cloud 28 (step 610). Step 610 optionally can include running aprocess to determine if the user has legitimate ownership rights todigital file 520, such as by generating a digital fingerprint fordigital file 520 and comparing the digital fingerprint to a database ofknown, verified digital fingerprints to determine if digital file 520was purchased legitimately or if it is an illegal “bootleg” copy. If thefirst one of devices 20 confirms the positive status of digital file 520(such as by confirming that it was purchased legitimately), computingcloud 28 sends digital file 521 to device 20 (step 612). Digital file521 contains the same exact content as digital file 520. However,digital file 521 was already stored in computing cloud 28 (as might bethe case if computing cloud 28 contains a large collection of digitalcontent, such as one might find in an online catalog or music provider),and therefore, digital file 520 need not be uploaded to computing cloud28 from the first one of devices 20, which would reduce the waiting timefor the user and would minimize the use of bandwidth between the firstone of devices 20 and computing cloud 28.

Additional detail for step 610 will now be described with reference toFIG. 42, which is similar to FIG. 40. The first one of devices 20generates digital fingerprint 550 for digital file 520 (step 640), usingthe method and system of Tang or some other known method and system. Thefirst one of devices 20 compares digital fingerprint 550 againstdatabase 560 containing a plurality of digital fingerprints for digitalcontent (step 642). Database 560 can be part of computer 10, or it canbe accessed by computer 10 over a network. Regardless of the exact typeof database 560 (Gracenote™, etc.) used, step 642 will indicate ifdigital file 520 is a file obtained legally or if it is an illegal“bootleg” copy or a file that cannot be identified or confirmed to belegitimate. Finally, the first one of devices 20 obtains the result ofstep 642, which indicates if the digital fingerprint indicates thatdigital file 520 is a legal copy or not (step 646). If digital file 520is a legal copy, then computing cloud 28 sends digital file 521 to thesecond one of devices 20 (step 612, described previously). If digitalfile 520 is not confirmed to be a legal copy, then computing cloud 28can optionally send a message to the second one of devices 20 indicatingthat it cannot send digital file 520 or digital file 521 to the secondone of devices 20 unless the user pays a fee to obtain the appropriatelicense rights to that file.

In a variation of this method, the first one of devices 20 can insteadsend the digital fingerprint 550 to computing cloud 28, and computingcloud 28 can compare digital fingerprint 550 against database 560 todetermine if digital file 520 is a legal copy.

The benefits of the embodiments described with reference to FIGS. 39-42are numerous. For example, it typically takes existing systems around 3seconds to create a digital fingerprint for a music file. If a userloads 1000 songs onto computer 10 or a first one of devices 20, thencreating digital fingerprints for all of those songs would take around3000 seconds. The embodiments of FIGS. 39-42 would enable the system toperform the digital fingerprinting process “on demand” so that when auser wishes to listen to a particular song on a second device shortlyafter loading a large collection of songs onto a first device, thesystem can perform the digital fingerprinting process only on that song(which will take around 3 seconds) and thereafter verify that the userhas the rights to obtain a copy of the song on that second device. Bycontrast, without these embodiments, the system would need to finishcreating the digital fingerprints for the entire collection of newlyloaded songs (or at least up until the point where the digitalfingerprint is created for the song in question) before it would beready to receive such a request to determine if a user has rights to aparticular song in that collection to enable it to be sent to the seconddevice.

Improved Playback of Digital Content

Another embodiment provides an improved method and system for the playback of digital content. With reference to FIG. 43, device 20 maintainsqueue 700. Queue 700 is a data structure stored in memory or anotherstorage device. Queue 700 contains exemplary entries 710, 720, 730, andothers. Queue 700 can include pieces of digital content selected by auser, such as songs that the user wishes to listen to. When device 20 isconfigured to play entries within the queue, it will start with thefirst entry 710. Once it is finished playing first entry 710, it willthen play the second entry 720, and so on. At any point while device 20is playing an entry within queue 700, the user can navigate throughother screens shown on device 20 and can view items associated withanother data structure 750. Data structure 750 can be an album,playlist, collection of music of video, a “top 10” list, or any otherassortment of digital content. In this example, data structure 750 is aplaylist including items 760, 770, and 780, which in this example aredigital songs. Here, the user selects item 760 for playing. At thatpoint, device 20 stops playing from queue 700 and begins playing item760. Device 20 can optionally enter an “autofill mode.” If it does enterautofill mode, when device 20 has finished playing item 760, it willthen start playing item 770 from data structure 750, and then will playitem 780. If at any time, the user selects a “back” or “previous song”command, then device 20 will play the previous song actually played ondevice 20, whether the prior song was from queue 700 or from datastructure 750. Using this autofill feature, there is no “downtime,” anddevice 20 is able to continue playing even though the user navigatedaway from queue 700. This embodiment facilitates the ability of the userof device 20 to explore various pieces of digital content.

While the foregoing has been with reference to particular embodiments ofthe invention, it will be appreciated by those skilled in the art thatchanges in these embodiments may be made without departing from theprinciples and spirit of the invention, the scope of which is defined bythe appended claims.

1. An electronic device, comprising: a communication unit configured tocommunicate with at least one server in a wireless data network; adisplay; an input unit configured to receive a user input; and aprocessor configured to receive, from the at least one server throughthe communication unit, information of digital content stored in the atleast one server in association with a content store of a user, tocontrol the display to present the received information, to receive,through the input unit, the user input for selecting a content based onthe received information, to control the communication unit to transmita request for the selected content to the at least one server, and toreceive, from the at least one server through the communication unit,the selected content among the stored digital content in response to thetransmitted request.
 2. The electronic device of claim 1, wherein theprocessor is configured to control the display to present a content listbased on the information received from the at least one server, thecontent list showing an indication that a digital content is not storedin the second device but is stored in the at least one server inassociation with the content store of the user.
 3. The electronic deviceof claim 2, wherein the presented content list distinguishes the digitalcontent not stored in the second device but stored in the at least oneserver in association with the content store of the user, from a digitalcontent stored in the second device and stored in the at least oneserver in association with the content store of the user.
 4. Theelectronic device of claim 1, wherein in response to a selection,through the user input unit, of a recipient from a recipient list, theprocessor is configured to transmit, to the at least one server throughthe communication unit, information on the recipient to request the atleast one server to provide a digital content, among the stored digitalcontent in the at least one server, to a third device corresponding tothe selected recipient.
 5. The electronic device of claim 1, wherein theinformation of the stored digital content in the at least one server ismetadata of the stored digital content in the at least one server. 6.The electronic device of claim 1, wherein the information of the storeddigital content in the at least one server is list information of thedigital content stored in the at least one server in association withthe content store of the user.
 7. The electronic device of claim 1,wherein the information of the stored digital content in the at leastone server comprises at least one of title information, artistinformation, and genre information.
 8. The electronic device of claim 1,wherein the information of the stored digital content in the at leastone server is list information of digital content stored in the at leastone server in association with the content store of the user, the listinformation including a listing of the digital content received from afirst device and digital content received from a cloud-based service. 9.A non-transitory computer readable medium comprising instructionsexecutable by a computer to cause the computer to perform: receiving,from the at least one server, information of digital content stored inthe at least one server in association with a content store of the user;receiving a user input for selecting a content based on the receivedinformation; transmitting, to the at least one server, a request for theselected content based on the received information; and receiving, fromthe at least one server, the selected digital content in response to thetransmitted request.
 10. The non-transitory computer readable medium ofclaim 9, wherein the instructions are executable by the computer tocause the computer to further perform, in response to a selection of arecipient from a recipient list, transmitting, to the at least oneserver, information on the recipient to request the at least one serverto provide a digital content, among the stored digital content in the atleast one server, to a third device corresponding to the selectedrecipient.
 11. The non-transitory computer readable medium of claim 9,wherein the information of the stored digital content in the at leastone server is metadata of the stored digital content in the at least oneserver.
 12. The non-transitory computer readable medium of claim 9,wherein the information of the stored digital content in the at leastone server is list information of the digital content stored in the atleast one server in association with the content store of the user. 13.The non-transitory computer readable medium of claim 9, wherein theinformation of the stored digital content in the at least one servercomprises at least one of title information, artist information, andgenre information.
 14. The non-transitory computer readable medium ofclaim 9, wherein the information of the stored digital content in the atleast one server is list information of digital content stored in the atleast one server in association with the content store of the user, thelist information including a listing of the digital content receivedfrom a first device and digital content received from a cloud-basedservice.
 15. The non-transitory computer readable medium of claim 9,wherein the instructions are executable by the computer to cause thecomputer to further perform presenting a content list based on theinformation received from the at least one server, the content listshowing an indication that a digital content is not stored in thecomputer but is stored in the at least one server in association withthe content store of the user.
 16. The non-transitory computer readablemedium of claim 15, wherein the presented content list distinguishes thedigital content not stored in the computer but stored in the at leastone server in association with the content store of the user, from adigital content stored in the computer and stored in the at least oneserver in association with the content store of the user.
 17. A server,comprising: a communication unit configured to communicate with devicesin a wireless data network; a memory configured to store, in associationwith a content store of a user, a digital content received from a firstdevice; and a processor configured to control the communication unit totransmit, to a second device of the user, information of the digitalcontent, and to transmit, in response to a request from the seconddevice based on the information, the digital content to the seconddevice.
 18. The server of claim 17, wherein the information of thedigital content is metadata of the digital content.
 19. The server ofclaim 17, wherein the information of the digital content is listinformation of digital content stored in the memory in association withthe content store of the user.
 20. The server of claim 17, wherein theinformation of the digital content comprises at least one of titleinformation, artist information, and genre information.
 21. The serverof claim 17, wherein the memory is configured to store, in associationwith the content store of the user, the digital content received fromthe first device and digital content received by the server from acloud-based service.
 22. The server of claim 21, wherein the informationof the digital content is list information of digital content stored inthe memory in association with the content store of the user, the listinformation including a listing of the digital content received from thefirst device and the digital content received from the cloud-basedservice.
 23. The server of claim 17, wherein the processor is furtherconfigured to, if a selection of a third device is received from thesecond device, transmit to the selected third device a digital contentstored in the memory in association with the content store of the user.24. A non-transitory computer readable medium comprising instructionsexecutable by a computer to cause the computer to perform: receiving,from a first device of a user, a digital content; storing, inassociation with a content store of the user, the received digitalcontent; transmitting, to a second device of the user, information ofthe digital content; and transmitting, in response to a request from thesecond device based on the information, the digital content to thesecond device.
 25. The non-transitory computer readable medium of claim24, wherein the information of the digital content is metadata of thedigital content.
 26. The non-transitory computer readable medium ofclaim 24, wherein the information of the digital content is listinformation of digital content stored in association with the contentstore of the user.
 27. The non-transitory computer readable medium ofclaim 24, wherein the information of the digital content comprises atleast one of title information, artist information, and genreinformation.
 28. The non-transitory computer readable medium of claim24, wherein the storing comprises storing, in association with thecontent store of the user, the digital content received from the firstdevice and digital content received by the server from a cloud-basedservice.
 29. The non-transitory computer readable medium of claim 28,wherein the information of the digital content is list information ofdigital content stored in the server in association with the contentstore of the user, the list information including a listing of thedigital content received from the first device and the digital contentreceived from the cloud-based service.
 30. The non-transitory computerreadable medium of claim 24, wherein the instructions are executable bythe computer to cause the computer to further perform: receiving, fromthe second device, a selection of a third device; and transmitting, tothe selected third device, a digital content stored in association withthe content store of the user.